Using IKAROS to provide Scalable I/O bandwidth
نویسندگان
چکیده
We present IKAROS as a utility that permit us to form scalable storage platforms. IKAROS enable us to create ad-hoc nearby storage formations and use a huge number of I/O nodes in order to increase the available bandwidth. We measure the performance and scalability of IKAROS versus the IBM’s General Parallel File System (GPFS) under a variety of conditions. The measurements are based on benchmark programs that allow us to vary block sizes and to measure aggregate throughput rates. Keywords—parallel file system; resilient storage formations; GPFS; I/O bandwidth;
منابع مشابه
IKAROS Parallel File System client utility
I/O has become a bottleneck in application performance while the substantial amount of concurrency can cause a critical contention issue for I/O system. In this study we develop an IKAROS multithreaded client utility in C. IKAROS is a dynamically coordinated I/O system being used for addressing some of the limitations that current parallel file systems and storage architectures are facing with ...
متن کاملParallel I/O from the User's Perspective
Parallel I/O systems are gaining popularity as a means for providing scalable high bandwidth I/O. In this paper we develop abstract models of parallel I/O systems and provide empirical results that show how I/O intensive applications interact with the elements of parallel I/O systems. The abstract models are useful for explaining parallel I/O performance to developers of applications requiring ...
متن کاملImpact of Next-Generation I/O Architectures on the Design and Performance of Network Servers
The increasing demand for scalable and highly-available network services has challenged computer architects to develop new I/O architecture for servers. The recently released InfiniBand industry standard, for instance, provides scalable bandwidth and protected I/O communication using the memory-mapped communication model and a channelbased switched fabric technology. Advanced device controllers...
متن کاملPerformance Analysis of a Cluster File System
Design of cluster file system is very important for building a general-purpose cluster with commodity components. To provide scalable high I/O performance needed in the scientific computing, engineering computing, Internet/Intranet services, I/O intensive commercial database and multimedia application, we designed a high-performance cluster file system named COSMOS. This paper presents the basi...
متن کاملScalable I/O of large-scale molecular dynamics simulations: A data-compression algorithm
Disk space, input/output (I/O) speed, and data-transfer bandwidth present a major bottleneck in large-scale molecular dynamics simulations, which require storing positions and velocities of multimillion atoms. A data compression algorithm is designed for scalable I/O of molecular dynamics data. The algorithm uses octree indexing and sorts atoms accordingly on the resulting space-filling curve. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1504.00316 شماره
صفحات -
تاریخ انتشار 2015